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ABSTRACT 

Ee;:.earch which resulted in the development of the 
United States Employment Service Specific Aptitude Test Battery for 
use in selecting inexperienced or untrained individuals for training 
as Maintenance Repairer is described. Occupational norms were 
established in terms of minimum qualifying scores for each 
significant aptitude measure, which when combined, predict job 
performance. Statistical data, names of organizations participating 
in the study, job descriptions and supervisor's rating scales are 
included. (DEP) 
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Development of USES Specific Aptitude Test Battery S-363R75 

For 

Maintenance Repairer^ Factory or Mill (any Ind.) 899.281 

RESEARCH SUMMARY 

This report describes the research which resulted In the develop- 
ment of the following Specific Aptitude Test Battery for use In 
selecting inexperienced or untrained Individuals for training as 
Maintenance Repairers: 

Aptitudes Cutting Scores 

S - Spatial Aptitude 80 
Q - Clerical Perception 90 
M - Manual Dexterity 85 

Samol e : 

231* male Maintenance Repairers employed In the Norths South and 
West (see Appendix 1). A total of U8 were minority group members 
(23 Blacks^ 16 Spanish Surnamed^ 5 American Indians^ 2 Filipinos, 
1 Japanese and 1 French Canadian) and 186 were nonmlnorlty group 
fi;embers. 

Supervl sory ratings. Criterion data were collected during 1973 
and 1974. 

Design; 

Concurrent (test and criterion data were collected at about the 
same time). 

Valldl tv ; 

Phi coefficient for total sample » .22 (P/2 < .0005) 

Comparison of Minority and Nonmlnorltv Groups: 
It was not technically feasible to compare the validity of the 
battery for minority and nonmlnorlty groups as It was not possible 
to obtain data on a sufficient number of workers In any specific 
minority group to permit separate data analysis. 
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JOB ANALYSIS 

Job analysis was performed by observation of the workers' per- 
formance on the job and in consultation with the workers' super- 
visors. On the basis of the job analysis^ the lob description 
shown In Appendix 3 was prepared. The Job description was used to 
CI) select experimental samples of workers who were performing 
the job duties; (2) choose appropriate criteria or measures of lob 
performance; (3) determine which aptitudes are critical^ Important 
or irrelevant to job performance (see Tables 1 and k); and (k) pro- 
vide Information on the applicability of the test battery result- 
ing from this research. 

TABLE 1 

Qual 1 tatlve Analysis 

Aptitude Rationale 

G - General Learnl.ig Ability Required to understand instruc- 
tions and underlying principles 
of electrical and mechanical re- 
pairs and in diagnosing equip- 
ment problems and choosing the 
most practical and efficient 
method of repair. 

Required to read blueprints and 
schematics and to visualize 
machine parts and wiring In re- 
lationship to the total machine 
operations and functions. 

Required to Inspect equipment for 
wear and misalignment and to perceive 
pertinent details In blueprints and 
sketches. 

Required to read and record meter 
readings accurately and to read 
blueprints accurately. 

Required to use hand and power 
tools to dismantle^ repair and 
assemble equipment. 

EXPERIMENTAL TEST BATTERY 

All 12 tests of the GATB^ B-1002B^ were administered. 



S - Spatial Aptitude 



P - Form Perception 



Q - Clerical Perception 
M - Manual Dexterity 
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CRITERION 

The Immediate supervisor rated each worker. The ratings were 
obtained by means of personal visits of State test development 
analysts who explained the rating procedure to the supervisors. 
Two ratings were obtained from each supervisor with an Interval 
of at least two weeks between the ratings. Since sample members' 
test scores are confidential/ supervisors had no knowledge of the 
test scores of workers. 

A descriptive rating scale was used. The scale (see Appendix 2) 
consists of six items. Five of these items cover different 
aspects of Job performance. The sixth Item is a global Item on 
the Maintenance Repairer's "all-around" ability. Each item has five 
alternative responses corresponding to different degrees of Job 
proficiency. For the purpose of scoring the 1 tems/ weights of 1 to 
5 were assigned to the responses. The tot^l score on the rating 
scale is the sum of the weights for the six items. The possible 
ra'tige for each rating is 6-30. 



A review of the Job description indicated that the subjects covered 
by the rating scale were directly related to Important aspects of 
Job performance. 

A - Quantity of work: Repairs must be made In a timely manner 
in order to avoid delays and down time. 

B - Quality of work: Repairs must be done properly In order to 
avoid repetition of work. 

C - Accuracy of work: Defects must be diagnosed accurately in 
order for repairs to be made efficiently. 

0 - vlob knowledge: The worker must have sufficient knowledge to 
make repairs on the many different kinds of equipment for 
which he is responsible. 

E - Job versatility: Maintenance Repairers are required to 
repair and maintain a variety of equipment. 

F - "All-around" Job ability: Maintenance Repairer's value to 
the employer Involves a combination of aspects of Job per- 
formance listed above. 

A reliability coefficient of .82 was obtained between the Initial 
ratings and the reratingS/ Indicating a significant relationship. 
Therefore/ the scores of the two ratings were combined to form 
the final criterion. The possible range for the final criterion 
Is 12-60. The actual range Is 19-60. The mean Is ^1.9 with a 
standard deviation of 8.0. The relationship between the final 
criterion and oge/ education and Job experience is shown In 

Tcble 2. 

G 
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TABLE 2 



MeanS/ Standard Deviations (SD) and Pearson 
Product-Moment Correlations with the Criterion (r) for 
Age/ Education and Experience 



Mean Sp 



Range 



Age (years) 



9.9 

W.k 1.9 
106.1 91. t( 



.02 20-6t( 
.08 6-16 
.20** l-kkk 



Education (years) 
Experience (months 



on current job) 



**SIgnlf leant at the 



.01 level 



About one-third of the workers are considered to be marginal 
workers. Therefore^ the criterion distribution was dichotomized 
so as to Include about one-third of the sample In the low cri- 
terion group and the remainder In the high criterion group. The 
criterion cutting score was set at kti which places kl% In the low 
criterion group and S%% In the high criterion group. 



The sample consisted of 23^ male Maintenance Repairers employed In 
the North/ South and West (see Appendix 1). A total of kZ were 
minority group members (23 Blacks^ 16 Spanish Surnamed/ 5 American 
Indians/ 2 FillpInoS/ 1 Japanese and 1 French Canadian) and 186 
were nonmlnorlty group members. The means and standard deviations 
for age/ education and experience of the sample members are shown 
In Table 2. All workers had at least 3 months of experience In 
thel r current job. 



SAMPLE 



( 
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STATISTICAL RESULTS 

TABLE 3 
Statistical Results 

Apt I tude 

G - General Learning Ability 
V - Verbal Aptitude 
N - Numerical Aptitude 
S - Spatial Aptitude 
P - Form Perception 
Q - Clerical Perception 
K - Motor Coordination 
F - Finger Dexterity 
M - Manual Dexterity 

* Significant at the .05 level 

Table k summarizes the qualitative analysis and statistical results 
shown in Tables 1 and 3 and shows the aptitudes considered for In- 
clusion in the battery. 

TABLE k 

Summary of Qualitative and Quantitative Data 

AptI tudes 



Mean 




£ 


Ranee 


100.3 


15.9 


.11 


53-138 


95.5 


13.3 


.06 


65-139 


96.5 


17.6 


.06 


ko-m 


107.1 


18.6 


.16* 


51-163 


99.3 


21.7 


.08 


33-162 


107.0 


15.2 


.16* 


66-li»l 


93.8 


17.0 


.02 


k7-13k 


9i».5 


20.8 


.08 


"♦3-151 


95.2 


21.8 


.H»* 


25-157 



Type of Evidence 


G V N 


S P 


Q K 


F M 


"Critical" on Basis 
of Job Analysis 


"Important" on Basis 
of Job Analysis 


X 


X X 


X 


X 


"Irrelevant" on Basis 
of Job Analysis 


Relatively High 
Mean 


X 


X 


X 




Relatively Low Standard 
Deviation 


X 








Significant Correlation 
wi th Cr I terlon 




X 


X 


X 


Aptitudes Considered for 
Inclusion in the Battery 


G 


S 


Q 


M 
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The Information In Table k Indicates that the following aptitudes 
should be considered for Inclusion In the battery: and M. 

The objective Is to develop a battery of 2, 3 or k aptitudes with 
cuttinf scores set at five point Intervals at the point (a) where 
about the same percent will meet the cutting scores as the percent 
Placed In the high criterion group and (b) which will maximize the 
relationship between the battery and the criterion. The cutting 
scores are set at approximately one standard- deviation below the 
mean aptitude scores of the sample, with deviations above or below 
these points to achieve the objectives Indicated above. 

The following battery resulted: 

Aptitudes Cutting Scnr,>c 

S - Spatial AptI tude 80 
Q - Clerical Perception 90 
M - Manual Dexterity 85 

VALIDITY OF THE BATTERY 

TABLE 5 

Validity of Battery 

Below Meeting 
Cutting Scores Cuttlnr Scnr^^ Total 

High Criterion itO 
Group 

Low Cri ter ion 50 
Group 

Total 90 

Phi coefficient ■ .22 
Significance level ■ P/2 < .0005 



96 136 
"tS 98 
Ikk 23k 



OCCUPATIONAL APTITUDE PATTERN 

This occupation was incorporated Into OAP-37 In Section II of 
the 1970 edition of the Manual fnr the uses n.. neral AntUnM^ 
lest Battery with a double «ter I U because the aptitudes 

in the OAP differ from those In the battery for Maintenance 
Repairer but a significant phi coefficient was obtained between 
the criterion and the OAP-37 cutting scores of N-80, S-95 and 
M-85. A phi coefficient of .20 (P/2 < .005) was obtained for 
this sample* 
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APPENDIX 1 



Organizations Cooperating In the Study 

North 

3-M Company^ Chicago^ Illinois 

John Dere Waterloo Tractor WorkS/ Waterloo^ Iowa 
Chemagro/ Kansas CI ty^ Missouri 

Bethlehem Steel Corporation^ Bethlehem^ Pennsylvania 
National Presto Industries^ Inc.^ Eau Claire^ Wisconsin 

Maxwell House Coffee Company^ Jacksonville^ Florida 
Boise Southern^ De Rldder^ Louisiana 
Calkraft/ inc./ Elizabeth/ Louisiana 
De SotO/ inc./ Jackson/ Mississippi 
General Electric Company/ Jackson/ Mississippi 
Ralston Purina Company/ Jackson Mississippi 
Sandhills Furniture Company/ West End/ North Carolina 
Owens-l 1 1 inolS/ Waco/ Texas 

Appalachian Power Company/ St. AlbanS/ West Virginia 
Food Machinery Corporation/ Nitro/ West Virginid«^"^c^ss^ 
National Lead Corporation/ Charleston/ West Virginia 
Owens-in inols/ Huntington/ West Virginia 

Metropolitan Water Districts/ La Verne and Yorba Linda/ 
Cal I fornia 

Owens-l IllnolS/ Los Angeles/ Oakland/ Tracy and Vernon/ California 
Colorado Fuel and Iron Steel Corporation/ PueblO/ Colorado 
Kennecott Copper Corporation/ McGMI/ Nevada 
Arizona Public Service/ Frultland/ New Mexico 
Sun Bell Corporation/ Albuquerque/ New Mexico 
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U.S. OKPARTMCNT OF LABOlT * M/tNMWKR /.DMIN*tTI«ATION 

DESCRIPTIVE RATING SCALE 

SCORE. 

RATING SCALE FOR 



D.O.T. Title and Code 



Directions: Please read the "Suggestions to Raters" and then fill in the items which follow. In making your 
ratings, only one box should be checked for each question. 

SUGGESTIONS TO RATERS 

We are asking you to rate the job performance of the people who work for you. These ratings will serve as 
a "yardstick" against which we can compare the test scores in this study. The ratings must give a true picture 
of each worker or this study will have very little value. You should try to give the most accurate ratings 
possible for each worker. 

These ratings are strictly confidential and won't affect your workers in any way. Neither the ratings nor 
test scores of any workers will be shown to anybody in your company. We are interested only in testing 
the tests.** Ratings are needed only for those workers who are in the test study. 

Workers who have not completed their training period, or who have not beer, on the job or under your 
supervision iong enough for you to know how well they can perform this woik should not rateU. 
Please inform the test technician about this if you are asked to rate any such woik<^rs. 

Complete the last question only if the worker is no longer on the job. 

In making ratings, don*t let general impressions or some outstanding trait affect your judgment. Try to 
forget your personal feelings abort the worker. Rate only on the work performed. Here are some more 
points which might help you : 

1. Please read all directions and the rating scale thoroughly before rating. 

2. For each question compare your workers with "workers-in-general** in this job. That is, compare your 
workers with other workers on this job that you have known. This is very important in small plants 
where there are only a few workers. We want the ratings to be based on the same standard in all the plants. 

3. A suggested method is to rate all workers on one question at a time. The questions ask about different 
abilities of the workers. A worker may be good in one ability and poor in another: for example, a very 
slow worker ma, * accurate. So rate all workers on the first question, then rate all workers on the second 
question, and so o i. 

4. Practice and experience usually impiove a worker*s skill. However, one worker with six months' experience 
may be a better worker than another with six years' experience. Don't rate one worker as poorer than 
another merely because of a lesser amount of experience. 

5. Rate the workers according to the work they have done over a period of several weeks or months. Don't 
rate just on the basis of one "good" day, or one "bad " day or some single incident. Think in terms of 
each worker's usual or typical performance. 

6. Rate only the abilities listed on the rating sheftt. Do not let factors such as cooperativeness, ability to 
get along with others, promptness and honesty influence your ratings. Although these aspects of a worker 
are important, they are of no value for this study as a "yardstick" against which to compare aptitude 

test scores. 
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(Utt> 



<nnt> 



SEX: 



MALE 



FEMALE 



Company Job Title: 



How often do you see this worker 
in a work situation? 



How long have you worked with thii worker? 



□ All the time. 



Q Under one month. 



O Several times a day. 



O One to two months. 



O Several times a week. 



□ Three* to five months. 



□ Seldom. 



□ Six months or more. 



A How much can this worker get done? (Worker's ability to make efficient use of time and to work at hi^ speed.) 
(If it - possible to rate only the quantity of work which a person can do on this job as adequate or madequate, 
use #z to indicate "inadequate" and #4 to indicate "adequate.") 

□ 1. Capable of very low work output. Can perfonm only at an unsatisfactory pace. 

□ 2. Capable of low work output. Can perform at a slow pace. 

□ 3. Capable of fair work output. Can perform at an acceptable pace. 

□ 4. Capable of high work output. Can perform at a fast pace. 

□ 5. Capable of very high work output. Can perfonm at an unusually fast pace. 

B. How good is the quality of work? (Worker's ability to do high-grade work which meets quality standards.) 

□ 1. Performance is inferior and almost never meets minimum quality standards. 

□ 2. Performance is usually acceptable but somewhat inferior in quality. 

□ 3. Performance is acceptable but usually not superior in quality. 

□ 4. Performance is usually superior in quality. 

□ 5. Performance is almost always of the highest quality. 

C. How accurate is the work? (Worker's ability to avoid making mistakes.) 

□ 1. Makes very many mistakes. Work needs constant checking. 

□ 2. Makes frequent mistakes. Work needs more checking than is desirable. 

□ 3. Makes mistakes occasionally. Work needs only normal checking. 

□ 4. Makes few mistakes. Work seldom needs checking. 

□ 5. Rarely makes a mistake. Work almost never needs checking. 
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l^u "^""l^^l ^2?^ ? (Worker's understanding of the principles, equipment, materials 
and methods that have to do directly or indirectly with the work.) r r ^ r » 

□ 1. Has very limited knowledge. Does not know enough to do the job adequately. 

□ 2. Has little knowledge. Knows enough to get by. 

□ 3. Has moderate amount of knowledge. Knows enough to do fair work. 

□ 4. Has broad knowledge. Knows enough to do good work. 

□ 5. Has complete knowledge. Knows the job thoroughly. 

^' ?^«Ss) ^"^^^ perform efficiently? (Worker's ability to handle several different 

□ 1. Cannot perform different operations adequately. 

□ 2. Can perform a limited number of different operations efficiently. 

□ 3. Can perform several different operations with reasonable efficiency. 

□ 4. Can perform many different operations efficiently. 

□ 5. Can perform an unusually large variety of different operations efficiently. 

F. Considering all the factors already rated, and only these factors, how good is this worker? (Worker's all-around 
ability to do the job.) 

□ 1. Performance usually not acceptable, 
n 2. Performance somewhat inferior. 

O 3. A fairly proficient worker. 

□ 4. Performance usually superior. 

□ 5. An unusually competent worker. 

Complete the following ONLY if the worker is no longer on the job. 

G. What do you think is the reason this person left the job? (It is not necessary to show the official reason if you 
feel that there is another reason, as this form will not be shown to anybody in the company.) 

□ 1. Fired because of inability to do the job. 

□ 2. Quit, and I feel that it was because of difficulty doing the job. 

□ 3. Fired cr laid off for reasons other than ability to do the job (i.e., absenteeism, reduction in force). 

□ 4. Quit, and I feel the reason for quitting was not related to ability to do the job. 

□ 5. Quit or was promoted or reassigned because the worker had learned the job well and wanted to advance. 



RATED BY 


TITLE 


OATE 


COMPANY OR ORGANIZATION 

13 


LOCATION (City, Sfmte, ZIP Cod€> 
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Maintenance Repa! rer^ Factory or Mill (any Ind.) 899.281 

JOB DUTIES 

Repairs and maintains machinery^ plumbing and electrical systems. 



*Dlagnoses defects In equipment during regularly scheduled repairs 
or when breakdown occurs: Inspects equipment such as motorS/ 
generators/ swi tchboardS/ and product I on mach I nery for correct 
operation. Diagnoses defects In wiring using voltmeter and 
ammeter and following wiring diagrams and specifications. Dl*» 
agnoses defects such as wear or misalignment by visual Inspection 
or by measurement to determine if machinery i'*s within tolerances 
specified by manuals or drawings. Determines best repair 
methods and selects proper tools for the Job. 

*Repa!rs machinery: Dismantles equipment using hand and power 
tools. Removes defective^ worn or broken parts of electrical^ 
mechanical/ hydraulic/ or pneumatic systems. Repairs or replaces 
malfunctioning part. Reassembles equipment using knowledge of 
equipment or following manuals/ sketches or blueprints using hand 
and power tools. Checks and adjusts operation of equipment. 

Maintains equipment: Cleans equipment as required. Lubricates 
motorS/ shaftS/ gears and bearings. 

Repairs and installs plumbing: Uses plumbing equipment such as 
threading dies and wrenches to open clogged dralns/ repair or 
replace washroom fixtures and to install or replace gaS/ water/ 
hydraulic or pneumatic lines/ using knowledge of building codes 
and knowledge of system or by following specifications or blue- 
prints. 

Repairs electrical system of physical plant by replacing defec- 
tive components such as switches and fixtures. 



*These Job duties were designated as critical since they must be 
performed competently if the Job Is to be performed In a satis- 
factory manner. Maintenance Repairers spend about 90% of their 
working time performing these duties. 
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